BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home]
[Evaluation Methods]
[Master Result Table]
[Team Profiles]
[System Profiles]
Final Evaluation Results
on REG-TOTAL events by Approx. Span & Recur. matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] ==[REG-TOTAL]== 1653 ( 589) 1282 ( 588) 35.63 45.87 40.11
[ConcordU ] ==[REG-TOTAL]== 1653 ( 454) 910 ( 454) 27.47 49.89 35.43
[JULIELab ] ==[REG-TOTAL]== 1653 ( 579) 1694 ( 579) 35.03 34.18 34.60
[UT+DBCLS ] ==[REG-TOTAL]== 1653 ( 435) 1038 ( 434) 26.32 41.81 32.30
[VIBGhent ] ==[REG-TOTAL]== 1653 ( 287) 908 ( 287) 17.36 31.61 22.41
[ UNSW ] ==[REG-TOTAL]== 1653 ( 274) 962 ( 272) 16.58 28.27 20.90
[ UTokyo ] ==[REG-TOTAL]== 1653 ( 235) 686 ( 235) 14.22 34.26 20.09
[ UZurich ] ==[REG-TOTAL]== 1653 ( 245) 811 ( 245) 14.82 30.21 19.89
[UAntwerp ] ==[REG-TOTAL]== 1653 ( 183) 613 ( 183) 11.07 29.85 16.15
[ Cam ] ==[REG-TOTAL]== 1653 ( 165) 437 ( 165) 9.98 37.76 15.79
[ SCAI ] ==[REG-TOTAL]== 1653 ( 209) 1263 ( 209) 12.64 16.55 14.33
[ Team 24 ] ==[REG-TOTAL]== 1653 ( 155) 801 ( 154) 9.38 19.23 12.61
[ NICTA ] ==[REG-TOTAL]== 1653 ( 129) 712 ( 129) 7.80 18.12 10.91
[ UAveiro ] ==[REG-TOTAL]== 1653 ( 104) 494 ( 104) 6.29 21.05 9.69
[CNBMadrid] ==[REG-TOTAL]== 1653 ( 202) 2527 ( 202) 12.22 7.99 9.67
[CIPS-ASU ] ==[REG-TOTAL]== 1653 ( 196) 2404 ( 196) 11.86 8.15 9.66
[ASU+HU+BU] ==[REG-TOTAL]== 1653 ( 86) 257 ( 86) 5.20 33.46 9.01
[ UMich ] ==[REG-TOTAL]== 1653 ( 235) 3581 ( 235) 14.22 6.56 8.98
[ USzeged ] ==[REG-TOTAL]== 1653 ( 69) 379 ( 69) 4.17 18.21 6.79
[ UNIMAN ] ==[REG-TOTAL]== 1653 ( 67) 400 ( 67) 4.05 16.75 6.53
[CCP-BTMG ] ==[REG-TOTAL]== 1653 ( 51) 106 ( 51) 3.09 48.11 5.80
[ Team 09 ] ==[REG-TOTAL]== 1653 ( 40) 336 ( 40) 2.42 11.90 4.02
[ PIKB ] ==[REG-TOTAL]== 1653 ( 18) 59 ( 18) 1.09 30.51 2.10
[ KoreaU ] ==[REG-TOTAL]== 1653 ( 11) 29 ( 11) 0.67 37.93 1.31
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] ==[REG-TOTAL]== 1658 ( 427) 1038 ( 423) 25.75 40.75 31.56
[UAntwerp ] ==[REG-TOTAL]== 1658 ( 179) 613 ( 179) 10.80 29.20 15.76
[ Team 24 ] ==[REG-TOTAL]== 1658 ( 155) 818 ( 154) 9.35 18.83 12.49
[ASU+HU+BU] ==[REG-TOTAL]== 1658 ( 85) 257 ( 85) 5.13 33.07 8.88
[CNBMadrid] ==[REG-TOTAL]== 1658 ( 161) 2527 ( 161) 9.71 6.37 7.69
[CCP-BTMG ] ==[REG-TOTAL]== 1658 ( 50) 106 ( 50) 3.02 47.17 5.67
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------